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downstream links, and one which is informed by upstream links only. We find 
that, in general, both the mean and the fluctuation of the travel time are smallest 
when using the joint upstream-downstream control strategy. 
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1. Introduction 

The study of vehicular traffic has played an increasingly significant role in non- 
equilibrium statistical mechanics over recent years. There are a number of approaches 
which may be taken to traffic modeling; see for example the reviews [U [21 El HI El IS] ■ 
The use of cellular automata (CA) has been the subject of much study within 
the statistical mechanics community ever since the seminal work of Nagel and 
Schreckenberg [7] . A cellular automaton is a model which is discrete in time, space, and 
state variables, whose dynamical rules are local. The Nagel-Schreckenberg (NaSch) 
model is generally considered to be the minimal model for traffic on freeways. A huge 
literature dealing with various extensions of the NaSch model has evolved since its 
first appearance, and our understanding of freeway traffic has benefited greatly as a 
result. It is safe to say however that the behavior of traffic networks is still far less 
well understood. Much of the progress on traffic networks made within the statistical 
mechanics community has been focused on regular lattices (see e.g. [51 151 [TU1 ITT1 IT5] ) . 
although there are some notable exceptions [131 HH HH HE] ■ 

The aim of the current work is to improve our understanding of traffic networks by 
studying a crucial aspect of such networks: traffic lights. The model we use for network 
traffic flow in this paper is CA based and applicable to arbitrary road networks. The 
optimization of traffic lights is a major challenge in urban traffic networks |I7j . A 
natural idea, studied by several authors, is to link together or synchronize traffic 
lights [HI El HH EH [23 121] ■ It is acknowledged however that more flexible strategies 
are needed than just fixed-cycle controls [551 [221 US]- In this paper we will study 
an adaptive control strategy, for which traffic light switching schedules may be acyclic 
and green time durations are not fixed. Green times are determined by instantaneous 
local traffic information, such as up- and downstream vehicle densities. The main 
ideas of this approach have been discussed in [35] . 

Specifically, we apply our CA model to an actual urban road network in the 
Melbourne suburb of Kew, using empirical data as input, and then study the effect of 
applying different types of traffic signal systems. We also study our CA on a square- 
lattice network in order to test robustness and network independent features. The 
development of a realistic and computationally efficient network traffic model based 
on an existing system of traffic lights, is part of an ongoing collaboration with the 
Roads Corporation of Victoria (VicRoads) in Australia. 

1.1. Adaptive traffic signal systems 

The rules governing the traffic signals at signalized intersections in urban road 
networks play a crucial role in determining the network's overall efficiency. A number 
of adaptive traffic signal systems exist and are in use around the world. The Sydney 
Coordinated Adaptive Traffic System (SCATS) is a traffic signal system used to control 
traffic lights in numerous cities around the world, including Sydney, Melbourne, 
Shanghai and Detroit. SCATS is adaptive in the sense that it uses knowledge of the 
recent state of traffic in the network to choose appropriate values of the parameters 
controlling the traffic lights, such as the amount of green time given to the various 
possible movements through each signalized intersection. However, the only input data 
to which SCATS has access is the data provided from existing induction-loop detectors, 
usually located at the stop line, and this information is rather limited. The use of more 
sophisticated detectors on our roads, allowing the collection of more detailed data such 
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Figure 1. Google map of the chosen network (main roads only) in Kew, 
Melbourne, Australia. The size of the network is approximately 3.8km by 1.7km. 



as instantaneous link densities and queue lengths, has the potential to significantly 
increase the efficiency of urban road networks. It is therefore of significant interest 
to investigate generalized adaptive traffic signal systems, which utilize more detailed 
input data, such as the density of incoming and/or outgoing links, and the most 
practical way to do that is via numerical simulation. By studying such generalized 
adaptive schemes we may hope to gain insight into the potential benefits of installing 
more sophisticated detectors on our roads. 

Recently, certain types of adaptive or "self-organizing" traffic lights (SOTL) have 
been receiving attention in the statistical physics literature [TTl EH L26l EH [29] . Self- 
organizing traffic lights have been investigated in the simple context of a Manhattan- 
like network in [26] . In such a network each intersection has only two possible signal 
p/iase,||] either eastbound traffic has a green light and northbound traffic has a 
red light, or vice versa. We have generalized the ideas presented in [25] to handle 
intersections with multiple signal phases. This generalization from two to multiple 
phases allows a much richer variety of behavior. With only two signal phases, the only 
question one can consider is "how long should the active phase run before switching to 
the other phase." With more than two phases however, the more interesting question 
of "which phase should we switch to next" also arises. 

A further significant generalization that we introduce is that we not only consider 
the state of the upstream links which feed into a given intersection, but also the 
downstream links which are fed by the intersection. The idea being that not only is it 
important to give green time to a movement that will allow a congested upstream link 
to dissipate, but also that it is counterproductive to give green time to a movement 
that will further congest an already over-saturated downstream link. We find that 
for the Kew network, with boundary conditions corresponding to morning peak hour, 
the upstream-downstream adaptive traffic lights are approximately 5% more efficient 



f Clearly this usage of the word "phase" is unrelated to the usual meaning in statistical mechanics. 
Its widespread use in the traffic engineering literature hopefully sanctions our use of it here. 
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Figure 2. The network studied in our simulations, corresponding to the actual 
network in figure [l] Links with both endpoints shown are bulk links, while links 
with only one endpoint shown are boundary links. All link and node labels are 
arbitrary, but are used for reference within the text. 



than the simple upstream-only version. 

In order to test the robustness of these results, we then repeated the simulations 
on a square-lattice network, under a variety of boundary conditions. Specifically, 
we studied three choices of boundary conditions; strong westbound bias, uniform 
high density, and uniform low density. In the first two cases, our simulations again 
suggested that the upstream-downstream adaptive traffic lights performed better, 
being approximately 2-5% more efficient. For the low-density network, by contrast, 
there was no discernible difference between the two. 



2. A cellular automata model for generic urban road networks 

For clarity of presentation, we first sketch the main features of our traffic network 
model. A detailed algorithmic description is deferred to Appendix A| 



We represent a road network by a directed graph, composed of nodes (i.e. 
intersections) and links (ordered pairs of nodes, i.e. streets); see figure [2] With each 
link is associated an ordered list of lanes, and each lane is a simple one-dimensional CA 
obeying Nagel-Schreckenberg [7] dynamics. Arbitrary street lengths are implemented 
in the model by allowing the lanes on each link to have an arbitrary number of cells. 

The speed v of each vehicle can take one of v max + 1 allowed integer values 
v = 0, 1, 2, ... , u max . Taking the length of a cell to be 7.5m (corresponding to the 
typical space occupied by each vehicle in a jam) and the duration of each time step 
to be 1 second suggests v max = 3 is a reasonable choice for an urban network; i.e. 
each vehicle can move 0, 1, 2 or 3 cells per time step in such a CA model, depending 
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Figure 3. Typical example of a node in a road network. Here there are three 
inlinks and three outlinks, each consisting of two lanes. Each path P; is an ordered 
pair (in — lane, out — lane), and V = {Pi , P2, P4, P5, Pe} is a typical example of 
a phase associated with this node, consisting of five paths. 



on local traffic conditions. At each time step the positions of all vehicles are updated 
simultaneously, or in parallel, so that each vehicle makes its decision based on the 
same information. 

Lanes can act as turning lanes by inserting obstacles into an appropriate number 
of cells at the beginning of the lane. In addition, neighboring lanes on a given link can 
interact via lane changing, the details of which we discuss in |Appcndix A.2| Thus, 
the dynamics along each given link is essentially a standard CA freeway model [T], 
albeit with input and output rates that are determined dynamically by the rest of the 
network. The complication arises in how to glue these one-dimensional CA together 
to form a network. We have chosen the following simple model. 

2.1. Paths and Phases. 

We define a pa</[§]on node n to be an ordered pair (Ai n ,A ou t), where Ai n (A ou t) is a 
lane directed to (from) n. We implement the topology of a road network by assigning 
to each node a list of paths. When a vehicle reaches the end of a link it can only move 
to another link along one of the node's paths; see figure [3j If P = (A; n ,A ou t) then 
we shall write in(P) = Aj n and out(P) = A out . At a given node, we define a phase 
to be a particular subset of that node's paths. With each node is associated a set of 
phases V, and at any instant precisely one phase is declared to be the active phase for 
that given node. The effect of traffic lights is then implemented by demanding that 
vehicles may only traverse a path if it belongs to the active phase. The dynamics for 
how the active phase is chosen at each node, at each instant of time, is a crucial aspect 
of the network's dynamics, and can change the network's efficiency dramatically; see 
section [3] 

Within a given phase, we also allow each path to have a list of other paths to 
which it must give way. This allows us to model the fact that right turning vehicles 
often must give way to oncoming trafficjjfj even though they have a green light. For 

§ If one considers the road network as a directed multigraph, with lanes as edges, our paths are 

genuine graph-theoretical paths, of length 2. 

|| Assuming vehicles drive on the left side of the road. 
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example, if we added the path P3 to the phase V in figure [3] then path P3 would need 
to give way to paths P5 and Pq. If at a given time-step there would happen to be 
vehicles wanting to traverse both P3 and Pq for instance, then only the vehicle wanting 
to traverse Pq could proceed, while the vehicle wanting to traverse P3 would stop at 
the end of pj's inlink. 

2.2. Turning probabilities. 

In order to mimic origin-destination behavior, we demand that each vehicle makes a 
random decision about which link it wants to turn into at the approaching intersection. 
More precisely, for each node n, we assign to each ordered pair {1,1') , where I is an 
inlink and V an outlink of n, the probability ¥(l — s- V), that a vehicle on I wants to turn 
into V when it reaches n. In our model, the turning decision is made when the vehicle 
first enters I, since its choice of which link to turn into at the approaching intersection 
should influence its dynamics as it travels along I. In particular it influences the 
vehicle's choice of when to change lanes; see |Appcndix A. 2} 

2.3. Boundary conditions. 

When simulating a network, we must decide precisely where to put the boundary. 
Since all road networks are necessarily open systems, it must be the case that in any 
chosen network, some of the nodes are connected to links whose other endpoint is not 
part of the network. Any link with both endpoints contained in the chosen network 
we call a bulk link, whereas any link with precisely one node in the chosen network 
we call a boundary link. We can further classify the boundary links as being either 
boundary inlinks, if their to-node belongs to the network, or boundary outlinks, if their 
from- node belongs to the network. In figure [2] for example, the bulk links have labels 
1 through 38, while all the links 1001 through 1014 are boundary inlinks, and all the 
links 2001 through 2014 are boundary outlinks. Traffic flows into the network via 
boundary inlinks, and flows out of the network via boundary outlinks. 

A natural question to ask is: "To what extent should we simulate traffic on the 
boundary lanes?" To resolve this question we need to consider what boundary data 
is required, and available. Most importantly, we need to have appropriate boundary 
data determining the inflow and outflow of vehicles from the simulated network. In 
addition, if the traffic signals are being operated by SOTL we need to input appropriate 
values for the chosen demand function for each boundary lane; we discuss this further 
in sections [3j [5] and [6j 

Consider a boundary in-lane A of length ^physical metres, and suppose we visualize 
a discretization of A into L = i p h ys icai/7.5 equally sized cells, as we would do when 
simulating A using cellular automata. Unlike bulk lanes, it is not necessary to model 
boundary lanes in their entirety; we are free to model as much of A as we find 
convenient. Let i denote the first cell of A which is included in the CA. The two 
extreme cases are obviously i — 1 and i = L, however all choices in between are a 
priori sensible. See figure |4j 

Regardless of our choice, for boundary in-lanes A we are required to insert new 
vehicles into cell i with some given probability a\. It therefore makes sense to choose 
the amount of the boundary lane which we simulate using CA in such a way that 
a\ is easily obtained empirically. For our simulations of the Kew network, the most 
readily available, and probably most accurate, source of data comes directly from the 
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Figure 4. Boundary in-lane A for which CA modeling begins on cell i. 



occupancies of the stop-line loop detectors used by SCATS in Melbourne Let 
denote the density of position i in lane A. If o\ denotes the empirically measured (by 
SCATS) stop-line occupancy of lane A, then o\ « px.L- This suggests that for our 
simulations of Kew it is most sensible to only model the very end of each boundary 
in-lane, since we then have ot\ sa Pa,l> an d therefore to a good approximation ot\Ri o\. 
The simplest such strategy is to simply model the last cell of A, which, at each time 
step, is occupied with probability o\. This is the strategy we used for the simulations 
of the Kew network. We used a slightly different approach for the square-lattice 
simulations, as no boundary input data is available; see section [6j The input strategy 
is described in more detail in |Appcndix A.l| 

By contrast, for boundary out-lanes, A, we simply assume that px.i = 0, which 
should be a reasonable assumption except in the case of total grid-lock. We then 
simply let any vehicle which wants to enter lane A do so with probability 1, provided 
it has a green light. 

Finally, we emphasize that these questions of the optimal way in which to choose 
the boundary is a generic problem encountered by all network simulations; it is not 
related to the particular method (such as cellular automata) chosen to simulate traffic 
inside the network. 



2.4-. Time-inhomogeneous boundary conditions. 

The above discussion referred to the boundary conditions input into the model at 
a given instant of time. In general however, we may want to allow the boundary 
conditions to evolve as the simulation proceeds. With such boundary conditions we 
can, for example, study build-up and decay before and after the AM peak hour. 
For each lane A of each boundary link I we provide as input an M-vector 

( (1) (2) (AfK 

At times t = (j — 1) Tb + 1, ■ • ■ , j Tb we perform boundary inflow using the probability 
\ for each j = 1,2,..., M. After iteration t = MTb the simulation terminates. 
The system therefore defines a non-stationary stochastic process. Consequently no 
stationary distribution can be assumed to exist, and there is no reason to assume 
time averages converge to anything meaningful (as would be implied by the ergodic 
theorem) . 



2. 5. Overview of the model. 

A high-level description of our CA model is presented in algorithm [TJ The loop in 
algorithm [l] is over discrete time-steps, each time-step corresponding to 1 second. We 
emphasize that the dynamics defined by algorithm [T] correspond to updating all cells 



1 Data from 2009 for the Melburnian suburb of Kew has been made available to us by VicRoads 
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in parallel; i.e. all cells are updated based on the configuration at the same time step. 
In |Appcndix A| we elaborate in detail on each step in algorithm [T] 

Algorithm 1 
loop 

Inflow of vehicles into the network 
Lane changes on each link 

Mark the paths having vehicles wanting to traverse them 
Nagel-Schreckenberg dynamics on each lane 
Clear the marked paths on each node 
Update active phase of each node 
end loop 



3. Self-organizing traffic lights (SOTL) 

Suppose we agree on a suitable demand function d(V) which quantifies the demand 
of each phase V, of each given node. Phases with large values of d{V) should be 
candidates for being the next choice of the active phase, Tractive- However, we must 
also keep track of the time t(V) each phase has been idle, since we do not want a 
given phase to remain idle for too long, unless it has strictly zero demand. The key 
idea behind SOTL is to compute a threshold function, k(V), for each phase V, which 
depends on both the phase's idle time and demand function, and when n{V) reaches 
a predetermined threshold value, 

<V) > 6, (1) 

we consider making V the active phase. Perhaps the simplest reasonable quantity to 
use for the SOTL threshold function is 

n{V) = d{V)r{V). (2) 

Notice that n(V) is precisely zero whenever V has strictly zero demand, regardless of 
the size of t(P). However, if d^V) > then k("P) grows monotonically with t(V), so 
that k(V) will eventually become large even if d^) is small. This ensures that no 
driver can be left facing a red light indefinitely. 

There are potentially an infinite number of sensible choices for k and d that one 
could investigate. Regardless of the specific choices however, there should be a fixed 
cost associated with physically changing phases. To ensure we do not suffer excessively 
rapid switching between phases, we let r(n) denote the amount of time node n has 
been in phase Tractive and only allow n to change its phase if t(ji) > T m i n , for some 
fixed parameter T mm . We use T min = 5 throughout this paper. 

Algorithm[2]presents a general SOTL protocol for governing the signals on a node 
n with phases n = {P\,Vii ■ ■ •} (UAR abbreviates uniformly at random). When r(n) 
becomes larger than T m ; n , the algorithm determines the set of phases II' for which 
the threshold function n exceeds the threshold value 9. From LI' it then chooses the 
phases which attain the largest value of the threshold function, and among those it 
selects the phases which have been idle longest. Out of this latter set, called LI'", a 
phase is chosen at random to be the next active phase. In practice we find that II'" 
almost always contains not more than one element. 
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Algorithm 2 (Acyclic SOTL) 

Increment r(n) 

for each phase V =^ Tractive do 

Increment r(P) 
end for 

ifr(n) > T min then 

Let IT = {V E n : n(V) > 9} 

if TV ^ then 

Let n" = {Pen': k(V) = max^/gn' 

Le£ n'" = {Pe n" : t(V) = maxp^n" t{V')} 

UAR, choose V € II'" and set Active = V 

Set reactive) = 

Set r(n) = 

end i/ 
end i/ 



This implementation of SOTL is acyclic in the sense that we do not impose any 
fixed ordering on the phases. One could also easily define a cyclic version of SOTL 
which uses a threshold function only to determine when to switch to the next phase 
in the fixed cycle. 

Now let us consider the phase demand function in more detail. Given a suitable 
demand function d(P) defined on paths P, we define the demand of the phase V as 

i i PeV f 

Thus, the demand of the phase is just a weighted sum of the demands of each path 
it includes. Let us now comment on the weighting. The parameter ap denotes the 
number of paths belonging to node n which have in-lane in(P). For example, for the 
node in figure [3] we have ap 1 = o~p 6 = 1 and op i — 2 for i — 2,3,4,5. We refer to 
o~ p as the degeneracy of P. The weight l/o~p is included simply to ensure that paths 
with different degeneracies are weighted fairly, relative to each other. For example, 
consider again the node in figure [| The demand of the phase V = {P 1: P 2 , P4, P5, P&} 
is 

W = i(^) + ^^ + ^) + ^4 (4) 

The phase V services all the possible paths emanating from the lanes Ai = in(Pi), 
A2 = in(Pg) an d A3 = in(P4) = in(P5), while it only services one of two possible paths, 
namely P2, emanating from A4 = in(P2) = in(Pa). Therefore, the contributions to 
d(V) corresponding to Ai,A2,A3 all occur with unit weight, while that for A4 occurs 
only with weight 1/2. Note that weighting by l/crp implies that we are implicitly 
assuming all paths with the same in-lane are equally important; one could choose 
other weightings if, for a given in-lane, there were a reason to prefer one path over 
another. 

Now let us move from the general to the concrete, and introduce the following 
two-parameter family of path demand functions 

d(p) = P ™ {P) (i ~ Pout{P) y\ (5) 
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where p; n (p) and p ut(p) ar e the instantaneous space averaged densities on the lanes 
in(P) and out(P). The factor p[^ P ) in Q implies that it is desirable to give a green 
light to paths which have a congested m-lane. This is intuitively reasonable, and 
in fact similar schemes are already applied in practice by systems such as SCATS 
(although not by quantifying congestion in terms of the actual lane density). The 
factor (1 — p ut{P)) n has a complementary effect - it provides a disincentive to giving 
a green light to a path whose out-lane is already congested. This is again intuitively 
reasonable, however it seems that this second mechanism has been far less widely 
applied in actual adaptive systems used in practice. The simulations presented in 
sections [5] and [6] were performed using SOTL with demand function ([5]), with both 
(m, n) = (1, 0) and (m, n) = (1, 1). 

4. Observables 

4-1. Density, speed, flow and queue length 

We define the density, pi(t), of link I at time t to be the fraction of all cells on I 
which are occupied at that instant, and we define the space-mean speed, Vi(t), to be 
the arithmetic mean of the speeds of all vehicles on link In general, I will contain 
multiple lanes, and we compute pi(t) and vi(t) by summing over all the cells/vehicles 
on all the lanes of /. 

The flow, J\(t), of lane A during the tth time-step is simply the indicator for the 
event that a vehicle crosses the boundary between a fixed pair of neighboring cells 
during the tth update. The flow J\ (t) on link I at time t is then simply the arithmetic 
mean of the J\(t) over all A € I. 

There is some ambiguity in deciding on an appropriate definition of exactly when 
a vehicle should be considered queued. We use the following simple prescription. 

(i) When a vehicle first enters a link it is un-queued 

(ii) A vehicle becomes queued if and only if: 

(a) It is stopped 

(b) Every cell in front of it is occupied 

(iii) A queued vehicle remains queued until it turns into a new link 

Some comments are in order. Firstly, in this definition, we insist that a vehicle must 
be stopped in order to be queued. This is reasonable, since a vehicle with speed 1 cell 
per iteration is traveling at around 27km/ h, and if a vehicle's speed is always at least 
27km/ h it does not seem sensible to say it was ever queued. Secondly, insisting on 
having all cells in front of the vehicle occupied is perhaps a little conservative, but it is 
certainly the simplest choice, and any other choice would be decidedly ad hoc. Finally, 
the rule that a queued vehicle only becomes dequeued when it leaves the current link 
is designed to take into account stop-and-go behavior. I.e. a vehicle that was stopped, 
and then starts again, only to stop again later never really left the queue. Armed 
with the above definition, we can now unambiguously define Qi(t) to be the number 
of vehicles on link I which are queued at time t. 

Finally, we can compute network-mean observables p(t), v(t), J(t), Q(t), defined 
as the arithmetic means over all bulk links of all the corresponding link observables. 
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4-2. Statistics 

Since the boundary conditions vary with time in our simulations, the system does 
not settle into a unique stationary state. In particular, the ergodic theorem does not 
apply, so that time averages do not converge to stationary expectations. We therefore 
repeated each simulation n times, and for each value of t we estimated (X t ) via 

n 

n ^ 

i=i 

where A t is the realization of X t obtained during the iih run. Here X t might 
be the density of a link, or the space-mean velocity of a link, or indeed any of the 
observables mentioned in the previous section. In this way, for a given observable, X t , 
we estimate the average process (Xi), (A 2 ) .... All results in this paper are based on 
n = 100 simulation runs. 



4-3. Travel times 

In a given simulation, for each value of t we have a list T t [1 \T t {2 \ T t [kt) where k t 
is the number (possibly zero) of vehicles to leave the network at time t, and 7j is 
the total amount of time spent in the network by the ith such vehicle. In a simulation 
of duration T iterations, the total number of vehicles that have traversed the network 
is therefore 

T 

For a given simulation, we compute the mean total travel time per vehicle 

ET y^fct <T-(i) 



and its fluctuation 



•s 



— rp 

E t =i k t 



2 _ ELEtA (j) - m T f 



We emphasize that mj- and sj- are random variables. We again estimate the averages, 
(mj-) and (sj-) , by simply measuring mj- and sj- in n independent simulations and 
computing their arithmetic means. It seems intuitively reasonable that both (mj-) 
and (sj-) provide useful measures of network efficiency. 



5. Simulations Kew 

5.1. Empirical data 

A section of the Melbourne suburb of Kew consisting of fourteen signalized 
intersections was chosen as the network on which to test our cellular automaton; 
see figure [T] This network corresponds to the directed graph shown in figure [2] A 
list of nodes and links is input into the model in order to define the actual network. 
For each link the length, number of lanes, and speed limit must also be input, and 
for each node a list of phases must be provided. The phases input into the model are 
simplified versions of the actual phases used by SCATS, which ignore complications 
such as trams and pedestrians that are currently not taken into account in our model. 
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Figure 5. Smoothed time series of the empirical SCATS occupancies, into 30 
minute bins, on some representative boundary in-lanes of the Kew network. Link 
labels correspond to the labels in figure [2] 



5.1.1. Boundary Conditions In addition, suitable boundary conditions need to be 
applied to the model, and an initial configuration needs to be specified. We use 
boundary data in our model for two distinct purposes; as a means to correctly control 
the inflow and outflow of vehicles from the network, and also as a means of informing 
adaptive signal decisions at intersections on the boundary of the network. 

We use time inhomogeneous boundary conditions as explained in section pPj and 
empirical SCATS stop-line occupancies to implement the inflow rates as described in 
section 2J5 For each boundary in-lane of the network in figure [2j VicRoads provided 
us with a time series of the stop-line occupancy, with the exception of link 1012. In this 
case a three-lane link was covered by a single detector, making it impossible to obtain 
reliable data. For this link, we have used heuristically reasonable inflow rates based 



on simulations by the origin-destination software package MITM (see section 5.1.2 for 
more on MITM). 

The occupancy time series provided by VicRoads was for the period 6:30am to 
10:00am, in time intervals of 1 minute. To remove the effect of fluctuations due to 
traffic cycles, typically taking between two and three minutes, we smoothed this data 
into bins of 30 minutes, implying that Tb = 1800 iterations (simulated seconds) in 
our simulations (see section [2~4| for the definition of Tb). Smaller bins resulted in 
very noisy profiles. Figure [5] shows some examples of the data used. As described in 
section [2~3l at each instant of time, we use the stop-line occupancy, o\ to set the input 
probability, a\, into boundary in-lane A. 

In addition, for each boundary in-lane and each boundary out-lane, we require 
estimates of the total density, p\ , in order to set the SOTL demands according to the 
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demand function |5]). In the absence of any detailed empirical data for this quantity, 
we simply made the assumption that p x ~ o\, for boundary in-lanes, and arbitrarily 
set p\ = for the case of boundary out-lanes. This is almost surely an overestimate 
of p\ in the case of in-lanes. 

In all our simulations we started from an empty network, letting the system fill 
up using the time inhomogeneous boundary conditions. 



5.1.2. Turning probabilities For each node in the chosen network, VicRoads provided 
simulated data from the MITM software package that lists predicted volumes through 
each (inlink,outlink) pair, over a period of one hour. In order to estimate the 
required turning probabilities described in section [2] we computed turning ratios from 
these simulated volumes. We note that MITM is designed for city-wide demographic 
simulations, and so by using it to obtain turning probabilities at specific intersections, 
we are likely using it to answer questions on a spatial resolution beyond its designed 
accuracy. While the resulting values of the turning probabilities may therefore differ 
from reality, we do expect them to be at least indicative of the true results, for most 
intersections. In order to obtain more accurate turning probabilities, the MITM data 
could in principle be compared/augmented with SCATS data where available, however 
SCATS occupancies are not sufficient to obtain all the required turning ratios. 



5.2. Simulations 

5.2.1. Comparing SOTL vs fixed-cycle traffic lights. For the observables pi, Qi, Ji 
and vi defined in section |4j the left column of figure [6] shows typical examples of the 
average processes on an uncongested link (18 in figure[2]), using SOTL with demand 
function ^ and demand exponents (m,n) = (1,1), threshold 8 = 2. It seems that 
during each inflow epoch a new stationary state is reached, before the link is perturbed 
out of that state and into another one when the inflow probabilities are changed. This 
behaviour is clearly visible in the density plot, but is also apparent in the queue length 
and flow plots, and to a lesser extent in the speed plot. 

For comparison, we repeated the simulations using non-adaptive fixed-cycle traffic- 



lights (for a definition see Appendix A. 6 1 and measured the same observables. These 
are plotted in the right column of figure jey The green times for each phase in this case 
were obtained from the actual SCATS values during morning peak hour (7am-9am). 
Clearly, the fluctuations in these results are much larger than for SOTL. A similar 
observation was made by Lammer and Helbing in |27) . who studied self-organizing 
traffic lights using a fluid-dynamic model for the traffic flow in urban road networks. 

Figure [Tlshows typical examples of the average processes on a congested link 
(7 in figure |2j, both for SOTL with demand function ^ and demand exponents 
(m,n) — (1,1), threshold 9 — 2, as well as for fixed-cycle traffic lights. Unlike the 
uncongested plots it does not appear that stationarity is reached within the individual 
inflow epochs, suggesting that relaxation towards stationarity is much faster at low 
density than at high density. However, the transitions between inflow epochs are still 
visible in the density plot for SOTL. 

Figure [8] shows typical examples of the average network-mean processes, p, Q, J 
and v, both for SOTL and fixed-cycle traffic lights. There are jump-discontinuities in 
the SOTL evolutions of Q and J at times up to about t = 7000, suggesting that these 
system-wide observables manage to reach their stationary value within each of these 
early epochs. These jumps are less pronounced in p and v. For later times, the jumps 
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Figure 6. Uncongested evolution. From top: SOTL (left) vs Fixed Cycle 
(right) evolution of the density, queue length, flow and space-mean speed, on 
an uncongested link in the Kew network (link 18 in figure pj. The SOTL 
demand function (JsJ was used in the simulations, with SOTL demand exponents 
(m,n) = (1,1) and 9 = 2. Time inhomogeneous boundary conditions based on 
SCATS data were imposed, such as in figure [5] 



in any of the network observables are much less significant, suggesting that during 
later epochs, at the network level the system never really reaches stationarity. As the 
network is relatively uncongested during early epochs, this confirms that relaxation 
towards stationarity is much faster at low density than at high density. 

In summary, we find that SOTL gives better results than fixed-cycle traffic lights 
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Figure 7. Congested evolution. From top: SOTL (left) vs Fixed Cycle (right) 
evolution of the density, queue length, flow and space-mean speed, on a congested 
link in the Kew network (link 7 in figure [21. The SOTL demand function (JsJ was 
used in the simulations, with SOTL demand exponents (m,n) = (1, 1) and 9 = 2. 
Time inhomogeneous boundary conditions based on SCATS data were imposed, 
such as those shown in figure [5] 



for the means of the density, queue length, flow and speed. Furthermore, in all cases 
SOTL produces much smaller fluctuations. Moreover, at later times, when the network 
is congested but the boundary inflow decreases, SOTL allows the system to adjust 
more rapidly to the changed boundary conditions. 
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Figure 8. Network means. From top: SOTL (left) vs Fixed Cycle (right) 
evolution of the network-averaged density, space-mean speed, flow and queue 
length in the Kew network. The SOTL demand function (|5jl was used in the 
simulations, with SOTL demand exponents (m,n) = (1,1) and 8 = 2. Time 
inhomogeneous boundary conditions based on SCATS data were imposed, such 
as those shown in figure [5] 



5.2.2. Comparing upstream- only vs up stream- downstream SOTL. The average values 
of the travel time mj- and its fluctuation sj- are presented in figure [9] as a function of 
the SOTL threshold parameter for the two choices of exponents (m, n) = (1, 0) and 
(m, n) = (1, 1) in the SOTL demand function ([5]). The former choice corresponds to an 
upstream-only version of SOTL, while the latter corresponds to a hybrid upstream- 
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Figure 9. Mean travel time (mj-) and its fluctuation (st) vs SOTL threshold 
parameter 9, for the Kew network, with the SOTL demand function |5| and 
SOTL demand exponents (m,n) = (1,0), (1,1). The horizontal line shows the 
corresponding value for the system with fixed-cycle traffic lights. 



downstream version. For comparison, we include in the figures the corresponding 
values of (nij-) and (s-j-) for the network with fixed-cycle traffic lights, which are 
independent of 8. We begin by noting that both SOTL strategies result in significantly 
lower values of both (m-j-) and (st) than fixed-cycle traffic lights. The adaptive 
systems therefore not only outperform the fixed-cycle system on average, but they are 
also more reliable. The observation that SOTL produces smaller fluctuations for the 
vehicle travel time is entirely consistent with the behaviour presented in figures [6j [7] 
and [8] The (1,1) model appears to have an optimal value of 8 near 8 » 2, in terms 
of both (tut) and (st) . In both cases, there is range of 8 around 1 < 6 < 3 for which 
the dependence of (tut) and (st) on 8 appears weak. This suggests that the SOTL 
methodology is reasonably robust with respect to the parameter 8. 

Note also that for every value of 8 the values of both (7717-) and (st) for the 
(m, n) = (1,1) model are lower than the corresponding values for the (1,0) model. 
While the difference is not large, it is clearly statistically significant; see Table [T] 
Therefore, we can cautiously conclude that the (1,1) model is marginally more efficient 
(smaller travel times) and more reliable (smaller fluctuations in travel times) than the 
(1,0) model, for this network with the given boundary conditions. To produce a loose 



Table 1. Numerical values of the mean (ttit) and fluctuation (st) of 
the vehicle travel time for the simulations of the (1,0) and (1,1) models on 
the Kew network. The statistical error shown corresponds to one standard 
deviation. The units are minutes. For comparison, the corresponding values 
using fixed-cycle traffic lights are (iri7-}f c = 10.95±0.02 and {sj-){ c = 12.73±0.07. 





(m, n) 


= (1,0) 


(m, n) 


= (1,1) 


9 


W 


(st) 


K) 


(st) 


0.5 


10.14 ± 0.02 
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10.87 ± 0.03 
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10.34 ± 0.02 


2.0 


9.93 ± 0.01 
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9.29 ± 0.01 


9.14 ± 0.03 
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9.99 ± 0.01 
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9.46 ± 0.02 
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10.19 ± 0.01 


10.01 ± 0.02 


10.14 ± 0.02 


9.79 ± 0.02 
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Figure 10. Square grid with L x = 8 and L y = 4. The nodes in the network 
are represented by the full circles, while empty circles represent boundary nodes. 
Each link in the figure actually corresponds to two directed edges (one in each 
direction), each consisting of two lanes. 



estimate of the relative performance of the two models we note that 



min(m r ) (1]0) - min (ro r )(i,i) 

min (mr) (i,o) 
miri (s-r) (i,o) - min (sr) (i,i) 



5%, 
4%. 



min (s r ) (i,o) 
6. Simulations Square grid 

In addition to testing SOTL on the Kew network, we also tested it on a regular 



Lx ^ Ly square grid, as shown in hgure 1101 Each link in the network was given 



two lanes, and for simplicity we did not include turning lanes. Each node was given 
four phases; an east/west phase, a north/south phase, and two corresponding turning 



phases (corresponding to green turn-arrows and red lights), see figure 11 When 
we used fixed-cycle traffic lights, the ordering was east/west, turning, north/south, 
turning, east/west.. . . etc., corresponding to cyclically repeating the phases Vi, Vz, V3 
and V4. The lengths of all bulk links were set to 300 metres, which is of the order 
of a city block in Melbourne's CBD. We simulated the case L x — L y — 4, which is 
approximately the same size as the Kew network. It is of significant interest, however, 
to study the effect of varying L x and L y . We intend to pursue this in future studies. 

Let us define T to be the total duration of the simulation. To ensure the square- 
grid simulations were analogous to the Kew simulations we again chose to simulate 
for 3^ hours, so that T = 12,600s. We also emulated the effect of the AM peak hour 



by choosing time dependent boundary conditions, as shown in figure 12 



More precisely, on each boundary lane A we imposed the following time-dependent 
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(a) Vi = {Pi,P 2) . . . P s } (b) V 3 = {P 9 , P 10 , . . . Pi 6 } 

Figure 11. The phases used in the square-grid network were the east/west 
phase V\ = {P±, P2, ■ ■ ■ , Ps}, the north/south phase P3 = {Pg, P10, ■ ■ ■ , Pie}, 
and the two corresponding turning phases Vi = {Pi, Pi, P5, Ps} and P4 = 
{P 9 ,P 12 ,Pl3,Pl6}- 



density profile: 



Px(t) 



PA, max PA,: 

T 
± <J 



t + PA,min < t < T t 



PA, max 

Tg<t<T-Tg (6) 

PA, max Pa, h 



(T — t) + p A ,mi„ T -T g < t <T 



The parameter T g is the amount of time that the density profile spent growing, before 
plateauing at its maximum value, pA,max- In all our simulations we set T g — 3600s, 
i.e. 1 hour. Note that because we have assumed the profile is symmetric, T g is also 
the amount of time that the profile spends decaying after its plateau. 

There are two remaining free parameters in ([6]), pA,max and pA,mm- We ran 
simulations of the above networks under three different scenarios of (pA,max, PA,min)) 
corresponding to uniform low density, uniform high density, and a strong westbound 
bias. The precise values used in each of these scenarios are described in the sections 
to follow. We note that, analogously to the simulations we performed on the Kew 
network, we chose to bin the profile (|6| into bins of Tg = 30 minute duration. While 
binning is necessary for smoothing empirical data, as used in the Kew simulations 
discussed in Section [5j it is in principle not necessary here; our motivation for using 
binning here was simply to avoid introducing irrelevant differences between the Kew 
and square-grid networks. In section |6.2| we discuss in detail the effects of choosing 
different values of the binning time Tg. 

At each instant of time, the value of Pa(^) was used to inform the SOTL demand 
function for nodes adjacent to boundary links. Furthermore, we chose to set the 
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Figure 12. Time-dependent density profile used in the square-grid simulations. 
Cf. equation jfj}. 



lengths of boundary in-lanes to 150 metres (half the value of the bulk lanes), which 
allowed us to legitimately set the boundary input probability to be ot\ = p\. See 
section 2.3 For boundary out-lanes we again simply set p\ \ = 0. 

Finally, for each intersection we had to set the following twelve turning 
probabilities, 



/ Pww 


PWN 


Pws\ 


Pee 


PEN 


PES 


Pnn 
V Pss 


Pnw 


Pne 
PSE / 


PSW 



where pnw is the probability that a northbound vehicle chooses to turn onto a 
westbound link at the approaching intersection, and the other eleven parameters are 
defined analogously in the obvious way. We chose turning probabilities in a way that 
was consistent with each of the above three boundary profile scenarios. The precise 
values in each case are described below. 



6.1. Westbound bias in the boundary conditions 

To produce strong westward bias we set p\,xom = 0.1 for all boundary in-lanes A, and 
set pa, max = 0.4 for westbound in-lanes and pA.max = 0.2 for all the other in-lanes. 
The turning probabilities were also chosen to impose a westward bias, as follows: 

0.2 0.2 
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(7) 



6.1.1. Comparing SOTL vs fixed- cycle traffic lights. In figures [13] and [14| we show 
plots of the link observables pi, vi, Qi and Ji, on westbound and northbound bulk links. 
Due to the symmetry of the boundary conditions southbound links behave identically 
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Figure 13. Westbound Bias. From top: SOTL (left) vs Fixed Cycle (right) 
evolution of the density, queue length, flow and space-mean speed, on a given 
westbound link for the westbound-biased 4x4 square grid. The SOTL demand 
function (JsJ was used in the simulations, with SOTL demand exponents (m,n) = 
(1,1) and 6 = 2. Time inhomogeneous boundary conditions of figure [l2| were 
imposed. 



to northbound links, and we find that also eastbound links behave similarly. We 
compare SOTL (left column) with (m,n) = (1,1) and 8 = 2, vs fixed-cycle traffic- 
lights (right column). The fixed green time of each phase used in the fixed-cycle 
simulation was determined from the corresponding SOTL values midway through the 
morning peak hour. We further note that since we are binning the boundary inflows 
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Figure 14. Westbound Bias. From top: SOTL (left) vs Fixed Cycle (right) 
evolution of the density, queue length, flow and space-mean speed, on a given 
northbound link for the westbound-biased 4x4 square grid. The SOTL demand 
function (JsJ was used in the simulations, with SOTL demand exponents (m,n) = 
(1,1) and 8 = 2. Time inhomogeneous boundary conditions of figure [l2| were 
imposed. 



in the same way as for Kew, i.e. the boundary inflows change every 1800 second, the 
profiles show artificial jumps as a result. 

For the westbound link, the means for fixed-cycle traffic lights are comparable 
to SOTL, and in some cases even marginally better. However, they are considerably 
worse for the northbound link. In both cases, the fluctuations for SOTL are much 
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smaller than those for fixed-cycle traffic lights. Furthermore, the northbound link, 
being less congested, adjusts more rapidly to the changing boundary conditions at 
later times than the westbound link. 



6.1.2. Comparing up stream- only vs up stream- downstream SOTL. The average values 



of the travel time mj- and its fluctuation sj- are presented in figure 15 Both the (mj- 




Figure 15. Mean travel time (rrif) and its fluctuation (sj-) vs SOTL threshold 
parameter 9, for the westbound-biased 4x4 square grid, with the SOTL demand 
function (JsJ and SOTL demand exponents (m,n) = (1,0), (1, 1). The horizontal 
line shows the corresponding value for the system with fixed-cycle traffic lights. 



and (57-) curves appear to have an optimal value around 9 ss 2 for the (m, n) = (1, 1) 
system, and a slightly larger optimal value around 6 ~ 3 for the (1,0) system. For 
both SOTL systems, the curves for both (m-j-) and (57-) lie well below the horizontal 
line corresponding to fixed-cycle traffic lights, except for large 9. Furthermore, just as 
we found for the Kew network, for every value of 9 the values of (mj-) and (sj-) for 
the (m,n) = (1, 1) model provide lower bounds on the corresponding value for (1,0), 
to within statistical errors. For small and large 9 the difference between the (1,0) 
and (1, 1) models does not appear to be statistically significant, but it certainly does 
appear to be statistically significant for 1 < 6 < 2. See Table [2j Therefore, we can 
conclude that the (1, 1) model is again both more efficient and more reliable than the 
(1,0) model. To quantify this approximately, we note that 

min (mr) (1,0) -min(m r ) (1,1) „ 

; — / 1 ~ 0/0, 

mm (mr) (1,0) 

min (s r )(i,o) - min (s r )(Li) l0/ 

—, — r ~ l/o. 

rom(s r )(i,o) 



6.2. Effect of varying the binning time 

As noted previously, we chose to bin the profile ^ into bins of Tb — 30 minutes, 
in order to avoid introducing irrelevant differences between the Kew and square-grid 
networks. From the perspective of the square lattice, however, the choice Tb — 30 is 
essentially arbitrary, so in this section we investigate the effect of varying the value of 
Tb- This is of interest for the following reason. As can be seen from the plateaus in 
figures [6] and |8j as well as in figures [13] and |14[ when using Tb = 30 minutes, many 
observables relax to approximate stationarity within each individual inflow epoch. In 
real traffic situations however, the input rates may change on a faster time scale. In 
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addition, for larger networks the relaxation time would be larger, and the network may 
only reach stationarity on a time scale larger than Tg = 30 minutes. We therefore 
studied the effect of using smaller values of Tg, within which the network is not able 
to reach stationarity. 



In figure 16 we plot the link observables for a northbound link on the westbound- 
biased square grid with Tg = 5 minutes. It can be seen that in contrast to the 
corresponding figure [14] for Tg — 30 minutes, the profiles do not plateau, and hence 
this link does not reach stationarity within the inflow epoch of 5 minutes. Similar 
behaviour was observed on the other links in the network. It seems natural, therefore, 



to expect that the dependence of {my) and (s-f) on 6 displayed in figure 15 may be 
modified when Tb = 5 minutes 
of 



[m T/ 



and 



Figure T7j shows that this is not the case; the plots 
(sj-) for the system with Tb 



5 minutes shown in figure 17 



are in fact 
30 minutes, m 
10 



qualitatively the same as those in figure 15 for the system with Tg 
Similar results were also observed for the (mj-) and (st) plots when using Tg 
and Tg = 15 minutes. In summary, we have found strong evidence that the shape of 
the (m-f) and (sj-) plots are quite robust to changes in the parameter Tg, regardless 
of whether Tg is small or large compared to the relaxation time of the network. 



6.3. Uniform high-density boundary conditions 

To produce uniform high-density boundary conditions, for each boundary in-lane we 
set pa. max = 0.8 and pA,min = 0.2, and the turning probabilities were chosen to be 

0.25 0.25 1 



V 



PWN 


Pws 


PEN 


PES 


Pnw 


PNE 


Psw 


PSE 



/0.5 
0.5 
0.5 

Vo.5 



0.25 
0.25 
0.25 




(8) 



I pww 

Pee 
Pnn 
Pss 

These turning probabilities imply that regardless of a vehicle's direction, it chooses 
to continue straight with probability 1/2, and turn either left or right with 
probability 1/4. 

+ We note that using our particular binning procedure, the area under the input profile in figure|6]is 
slightly larger when using a discretization of Tb = 5 minute bins than when using Tb = 30 minute 
bins. The slight upward shift in the travel time profiles for the Tb = 5 simulations relative to the 
Tb = 30 simulations can therefore be understood as a simple consequence of a slightly higher total 
volume of vehicles that enter the network during the simulation. 



Table 2. Numerical values of the mean (mj-) and fluctuation {s-j-) of the 
vehicle travel time for the westbound-biased simulations of the (1,0) and (1,1) 
models. The statistical error shown corresponds to one standard deviation. The 
units are minutes. For comparison, the corresponding values using fixed-cycle 
traffic lights are (m r ) fc = 3.43 ± 0.01 and (s r ) ic = 3.93 ± 0.02. 
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Figure 16. Westbound Bias. From top: SOTL (left) vs Fixed Cycle (right) 
evolution of the density, queue length, flow and space-mean speed, on a given 
northbound link for the westbound-biased 4x4 square grid with Tg = 5. The 
SOTL demand function (JsJ was used in the simulations, with SOTL demand 
exponents (m,n) = (1, 1) and 8 = 2. Time inhomogeneous boundary conditions 
of figure [l2] were imposed. 



6.3.1. Comparing SOTL vs fixed-cycle traffic lights. In figure 18 we compare the 
evolution of the link observables pi, Qt, J; and vi for the high-density square-lattice 
network for the adaptive SOTL update vs fixed-cycle traffic lights. The SOTL demand 
function ([5| was used in the simulations, with SOTL demand exponents (m, n) = (1, 1) 
and 9 = 2. Again, the values of the fixed green times in the fixed cycle simulations 
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Figure 17. Mean travel time (mj-) and its fluctuation (s-j-) vs SOTL threshold 
parameter 8, for the westbound-biased 4x4 square grid using Tb = 5, with the 
SOTL demand function (JsJ and SOTL demand exponents (m,n) = (1,0), (1,1). 
The horizontal line shows the corresponding value for the system with fixed-cycle 
traffic lights. 



were determined from the corresponding SOTL values midway through the morning 
peak hour. As for the Kew network studied in section[5j SOTL clearly performs better, 
in particular the density and queue lengths of SOTL are significantly lower than for 
fixed-cycle traffic lights, while the flow is larger. Moreover, at later times when the 
network is congested but the boundary inflow decreases, SOTL allows the system to 
adjust more rapidly to the changed boundary conditions. Finally, the fluctuations 
produced by SOTL are again much smaller than those for fixed-cycle traffic lights. 
In figure [19] we compare the evolution of their network averages, which show similar 
behaviour. 



6.3.2. Comparing upstream- only vs up stream- downstream SOTL. The average values 
of the travel time mj- and its fluctuation sj- are presented in figure |20| Unlike the 
behaviour displayed in figures [9| and 1 1 5 1 there does not appear to be an optimal value of 
9 for the (mj-) curve for the (m, n) — (1. 1) model, and in fact the curve is only rather 
weakly dependent on 9. Another interesting feature is that although the fixed-cycle 
traffic lights (whose green times were chosen by analysing simulated green times from 
SOTL simulations using the (m, n) — (1, 1) model) are less efficient than (1, l)-SOTL 
for all the 9 we studied, they are more efficient than (1, 0)-SOTL for all 9 > 3. 

Once again, for every value of 9 the values of (mj-) and (s-f) for the (m, n) ~ (1, 1) 
model are lower than the corresponding value for the (1,0) model. The difference is 
statistically significant, except possibly for 9 < 1; see Table [3| Therefore, we again 
conclude that the (1, 1) model is marginally more efficient and more reliable than the 
(1,0) model. To approximately quantify this we note that 

min (mr)(i,o) - min (m r )(i,i) & 
mm (m-r) (1,0) 

min (s r ) (1,0) - min (s r )(i,i) „ 

~i — \ ~ 4/o - 

una (s r ) (1,0) 
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6.4- Uniform low-density boundary conditions 

To produce uniform low-density boundary conditions, for each boundary in-lane we 
set Pa. max = 0.2 and px,min = 0.1, and the turning probabilities were again chosen 
according to 
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6.4-1- Comparing SOTL vs fixed-cycle traffic lights. In figure 21 we compare the 
evolution of the link observables pi, Qi, Ji and vi for the low density square- lattice 
network for the adaptive SOTL update vs fixed-cycle traffic lights. The SOTL demand 
function ([5| was used in the simulations, with SOTL demand exponents (m, n) — (1, 1) 
and 6 = 2. The fixed cycle times were again determined from the SOTL values midway 
through the morning peak hour. In figure 22 we compare the evolution of their network 
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(m,n)=(l,0) i — h- 



Figure 20. Mean travel time (mj-) and its fluctuation {«t} vs SOTL threshold 
parameter 8, for the high-density 4x4 square grid, with the SOTL demand 
function (JsJ and SOTL demand exponents (in,n) = (1,0), (1, 1). The horizontal 
line shows the corresponding value for the system with fixed-cycle traffic lights. 



averages. As for the Kew network studied in section [5] the means of both link and 
network observables are better for SOTL than for fixed-cycle traffic lights. Also, as 
before, the fluctuations for SOTL are significantly smaller. 

6.4-2. Comparing upstream-only vs up stream- downstream SOTL. The average values 



of the travel time mj- and its fluctuation sj- are presented in figure 23 For 9 < 2, the 
(m-j-) curve is not very sensitive to the precise value of 9, while the (57-) curve has 
an optimal value at around 9 ~ 2. By contrast with the previous cases, there is no 
statistically significant difference between the (1, 1) and (1,0) curves in this case, for 
cither {m-j) or (s-7-). See Table [4] for the exact numerical values. This is intuitively 
reasonable - for a network in which all links are freely flowing one would not expect 
an advantage from monitoring the downstream congestion, since it will always be 
negligible. 

7. Conclusion 

The main aims of this work have been to try and (partially) answer the questions of 
how adaptive signal strategies improve urban traffic flow, and what type of adaptive 
strategies perform best. To investigate these questions, we have developed a realistic 



Table 3. Numerical values of the mean (m~r) and fluctuation (^7-) of the 
vehicle travel time for the high-density simulations of the (1, 0) and (1, 1) models. 
The statistical error shown corresponds to one standard deviation. The units arc 
minutes. For comparison, the corresponding values using fixed-cycle traffic lights 
are (m r ) fc = 3.90 ± 0.01 and (s r >fc = 3.35 ± 0.01. 
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Figure 21. Low Density. From top: SOTL (left) vs Fixed Cycle (right) evolution 
of the density, queue length, flow and space-mean speed, on a given bulk link, for 
the low density 4x4 square grid. The SOTL demand function (JsJ was used in 
the simulations, with SOTL demand exponents (m, n) = (1, 1) and 9 = 2. 



network traffic simulation model, which we used to simulate two different networks. 
The first is an existing road network in the Melbourne suburb of Kew, for which we 
have experimental data available as input into our simulation model. For comparison 
we have also simulated a square-lattice road network, in order to test network 
independent features and robustness. 

On these two networks we have compared a non-adaptive signal system, with 
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fixed-cycle traffic lights, with a version of the adaptive SOTL (Self Organizing Traffic 
Lights) introduced by Gershenson [26]. In the cases studied, we find that averages 
of observables such as travel time, density, flow, queue length and speed are almost 
always better for SOTL than for the fixed-cycle strategy. Moreover, the fluctuations 
in these observables are significantly smaller for SOTL. This suggests that a regular 
traffic signal system results in fairly large fluctuations in traffic observables compared 
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Figure 23. Mean travel time (mj-) and its fluctuation («t) vs SOTL threshold 
parameter 9, for the low-density 4x4 square grid, with the SOTL demand function 
(JsJ and SOTL demand exponents (m, n) = (1, 0), (1, 1). The horizontal line shows 
the corresponding value for the system with fixed-cycle traffic lights. 



to a deregulated self-organizing signal system. A similar observation was recently 
made by Lammer and Helbing [37J in a self-organizing fluid-dynamic model for traffic 
flow in urban road networks. 

On both networks we have also performed a comparison of two specific types of 
SOTL strategies; one which is informed only by the congestion on upstream links, 
and another which is informed by the congestion on both upstream and downstream 
links. Our results show that for four typical systems studied, provided the network is 
sufficiently congested the latter strategy is both more efficient (smaller travel times) 
and more reliable (smaller fluctuations in travel times) than the former. For an 
uncongested network we found that there was no discernible difference between the 
two strategies. 

These results are only the tip of the ice berg. Firstly, it is of significant interest to 
obtain a more detailed understanding of how the relative efficiencies of the two SOTL 
strategies depends on network congestion. This is of crucial importance in determining 
whether the upstream-downstream strategy has any practical merit. Although in the 
systems we have studied, the efficiency gain from using the upstream-downstream 
strategy was modest, it is quite possible that there may be other regions of boundary 
input parameters in which the gains are far more significant. It is also conceivable 
that in some regimes of boundary input data the upstream-only strategy may in fact 



Table 4. Numerical values of the mean (iht) and fluctuation (st) of the 
vehicle travel time for the low-density simulations of the (1, 0) and (f , 1) models. 
The statistical error shown corresponds to one standard deviation. The units are 
minutes. For comparison, the corresponding values using fixed-cycle traffic lights 
are (m r ) fc = 2.53 ± O.Of and (s r }fc = 2.24 ± 0.01. 
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be more efficient. 

Furthermore, it is of great interest to study the effects of changing the network 
structure, in particular to study the above problems on much larger networks. To 
this end, the square-grid network discussed in section [6] is ideal - it is tailor made for 
studying the effect of increasing the network size parameters, L x ,L y , while retaining 
the important features of a realistic network such as discussed in section[5j Preliminary 
simulations show that simulating such square-grid networks with 100 intersections is 
easily within reach computationally. 
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Appendix A. Details of the network cellular automaton 

Appendix A.l. Inflow. 

For each lane, A, of each boundary inlink we are given as input an inflow probability 
a\. At each instant of time, if the first cell of A is empty, we add a new vehicle to this 
cell with probability u\. The value of a\ will in general vary during the simulation, 
however in this section it suffices to think of ct\ as being fixed, since we are discussing 
how to implement the inflow at a given instant of time. 

Since we will often estimate ct\ using an empirical stop-line occupancy, we 
typically model each boundary in-lane using a small number of cells. As a consequence 
of this, vehicles on boundary inlinks will most likely not have sufficient time to make 



topological lane changes (as described in section Appendix A.2|. We therefore make 
the (quite reasonable) assumption that a vehicle in lane A has decided to turn into 
a link which is connected to A via one of the node's paths. Consequently, vehicles 
entering boundary in-lanes make their turning decisions according to the conditional 
probabilities ¥{l -> l'\X), rather than P(Z -> I'). 

Our procedure for inserting new vehicles into the network can now be summarized 
simply by algorithm [3j 

Algorithm 3 (Inflow) 

for each boundary inlink I do 
for each lane X of I do 

if the first cell of X is vacant then 

With probability a\ add a new vehicle with speed v max to the first cell of X 
Make a turning decision for the new vehicle using P(Z — > Z'|A) 
end if 
end for 
end for 
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Finally, we need to express P(Z — > l'\X) in terms of the available data, F(l —>/'). 
It is quite reasonable to assume that there is one unique lane A' € I' for which a path 
AA' from A to I' exists. We therefore have 

P(i-»Y|A) =P(AA'|A), (A.l) 

where P(AA'|A) is the conditional probability that a vehicle on link I will traverse the 
path AA', given that it is on lane A. 

Now, if P(AA'|Z) is the probability that a given vehicle on link I will traverse the 
particular path AA', then it is clear that 

P(AA'|Z) 



P(AA'|A) = 



Eaa"P(AA"|0 



(A.2) 



The sum in (A.2 1 is over all paths AA" with in-lane A. As an example, if we take 
A = in(P2) in figure [3] then the sum is over two paths AA" where A" can be either 
A" = out(P2) or A" = out(pj). If there are kw paths AiA^ connecting link / to link I' , 
then clearly 

Kii/ 

>(A^|0=P(^O- (A.3) 



E 1 

; = 1 



As an example, if we take A = in(P2) and A' = out(p2) in figure [3] then kw = 2, 
whereas if we take A' = out(p3) we have kw = 1. In fact, we shall assume that all 
possible paths are weighted equally 

P(Z -> I') 



P(A l A' i |0 = " v " "' ■ (A.4) 
kw 

Combining (A.4), (A.2) and (A.l) then allows us to compute P(7 —> l'\X) from 
P(l — > I'), as desired. Equation (A.4) seems a perfectly reasonable assumption, since a 
driver would be expected to care only about which link they were about to turn into, 
not which particular lane they use to do so. 



Appendix A.2. Lane changing. 

Lane changing in CA traffic models is a rather well-studied topic, and our 
implementation follows closely the ideas presented in [5J [301 1311 13U [33] ■ We perform 
lane changing in two separate steps, so that we guarantee our network updates are 
carried out in parallel. For a given link, we firstly consider each occupied cell of each 
lane and decide which vehicles want to change lane, and all such vehicle's keep a record 
of which lane they want to change to. Then, once all vehicles have decided on their 
lane changes, we go through each cell of each lane again and execute the lane changes. 
This ensures that all vehicles make their lane changes based on information at the 
same time step. Once the lane changing decisions have been made, executing the lane 
changes is trivial, and so in this section we focus only on how to make the decisions. 
A vehicle may decide to change lanes for two distinct reasons: 

(i) Topological: to ensure the vehicle can make its desired turn at the approaching 
intersection 

(ii) Dynamic: to avoid bad traffic 

At each time-step, we propose for each vehicle a specific lane change, and then decide 
whether or not it should be executed. We only propose lane changes from left-to-right 
on even time steps, and lane changes from right-to-left on odd time-steps. This ensures 
that we never have two vehicles competing for the same cell. 
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Appendix A. 2.1. Topological lane changing. As already discussed, when a vehicle v 
first enters a link I — mn we randomly choose one of the possible outlinks V of the 
upcoming node n and assign /' to be the vehicle's destination. I.e. the vehicle has 
already decided to turn onto V when it reaches n. This defines a set of possible paths 
for v, denoted P v = {Pi}, which is the subset of all the paths belonging to n which 
have inlink I and outlink In order for v to make its desired turn at n it must traverse 
a path in V v . It may be the case however that v's current lane A is not the in-lane 
of any of the paths in V v . In this case v will need to make one or more lane changes 
in order to enter a lane from which the desired turn is possible. In this context, we 
say a lane change A i— > A' is allowed if the proposed new lane A' is the in-lane of a 
path in V v . In addition, we say a lane change is needed if A is not the in-lane of a 
path in V v , but A' or a lane to the right (left) of A' is the in-lane of a path in V v , if 
A' is to the right (left) of A. Allowed lane changes are not necessarily needed because 
it may be the case that there already exists a P e P v with in(P) = A. Conversely, 
a needed lane change may not be allowed according to this definition. Deciding if a 
proposed lane change is allowed and/or needed in the above senses of the terms is 
the only topological information required to decide whether to accept a proposed lane 
change. Algorithm [4] summarizes how to decide if a proposed lane change of vehicle v 
from lane A to lane A' ~ A is topologically allowed and/or needecfj 



Algorithm 4 (Topological lane changes) 

Consider a vehicle v on lane A, and a proposed A i— > A' 
if there exists P G V v such that in(P) = A' then 

A i— > A' is allowed 
else 

A h> A' is not allowed 
end if 

if there exists P € V v such that in(P) = A then 

A i— > A' is not needed 
else 

if A' > A and there exists P € P v such that in(P) > A' then 

A I— > A' is needed 
else if A' < A and there exists P € V v such that in(P) < A' then 

A n- A' is needed 
end if 
end if 



Appendix A. 2.2. Dynamic lane changing. Suppose a vehicle v cannot reach free 
speed due to congestion in its current lane A, and suppose further that the gap in 



A' ~ A is larger than that in A; see figure Al This provides a dynamic incentive 



for v to change lanes A H ► A', and when such an incentive exists we say A i — >■ A' is 
desirable. We allow v to make such a lane change provided it is safe to do so, and 
provided A h-> A' is topologically allowed (as defined above). We use algorithm [5] to 
decide whether A i— > A' is desirable and/or safe. The definition of safe presented in 



* By A ~ A' we mean that lanes A and A' are adjacent; i.e. they are consecutive in the lane ordering 
of their link. 



Traffic flow on realistic road networks with adaptive traffic lights 



30 



gap 

















2 




CO 




















































CO 









«back 



backward gap 



forward gap 



Figure Al. Typical situation arising in dynamic lane changing. Suppose 
fmax = 3. We are proposing to move the vehicle of speed v = 2 on the left lane, 
to the right lane. Since min(i> + 1, forwardgap, i) ma x) > min(i; + 1, gap, Umax) the 
lane change is desirable. Since backwardgap = 5 > t^back the lane change is also 
safe. 

Algorithm 5 (Dynamic lane changes) 

Consider a vehicle of speed v on lane X, and a proposed X > X' 



( See figure A 1 ) 



if backwardgap > Kback then 

A h> A' is safe 
end if 

if min(u + 1, forwardgap, w max ) > vam{v + 1, gap, u max ) then 

A h> A' is desirable 
end if 



algorithm [5] is stronger than merely ensuring vehicles avoid crashes; it ensures that 
the vehicle with speed i>back does not need to immediately decelerate. 

Appendix A. 2. 3. Lane change decisions. At even (odd) time steps, we consider each 
link, and consider each lane of that link except the rightmost (leftmost) lane, and 
consider each cell on that lane which contains a vehicle. We then use algorithm [6] to 
decide whether or not that vehicle should perform a lane change to the lane to its 
right (left). Note that we accept needed but unsafe lane changes with a probability 



Algorithm 6 (Lane change decision) 

Consider a vehicle on cell i of a lane X of length L, and a lane X' ~ A 
if cell i of lane X' is unoccupied then 
if X i— > A' is needed then 
if A i-> A' is safe then 

Accept X h> A' 
else if X > A' is not safe then 

Accept A h- > A' with probability i/L 
end if 

else if X i— > A' is not needed but is allowed, desirable and safe then 

Accept X i— >• A' with probability p c hange 
end if 
end if 
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i/L, which increases as we proceed along the lane. This is a simple way to mimic 
the increasing urgency of getting into an appropriate lane to make a desired turn at 
the approaching intersection. We emphasize however, that even though we describe 
such lane changes as unsafe, they cannot cause a crash because we explicitly demand 
that cell i on lane A' is empty. Perhaps a more accurate description for them would 
be impolite lane changes, since their effect is to force other vehicles to decelerate. We 
also remark that in practice we set p c hango < 1 to avoid platoons oscillating back and 
forth on consecutive time-steps. 



Appendix A. 3. NaSch Dynamics. 

Nagel-Schreckenberg(NaSch) dynamics refers to a standard one-dimensional stochastic 
dynamics, which is routinely utilized in freeway models. Each lane is divided up into 
cells of length 7.5m, which represents the approximate space occupied by a vehicle in 
a jam. We assume each time-step corresponds to 1 second, so that a vehicle may only 
have one of a discrete set of speeds which are multiples of 27km/ h. The key step in 
performing the NaSch updates is to compute new velocities for each vehicle. Suppose 
at time t a vehicle with speed v t € {0, 1, . . . , v max } is located in cell Xt, and has headway 
(number of empty cells ahead) equal to ht- Then the maximum speed this vehicle can 
safely achieve at the next time step is taken to be t> sa f c = min(u t + 1, f max , h t ), which 
allows for unit acceleration provided the speed limit is obeyed and crashes are avoided. 
Provided v sa f c > 0, a random unit deceleration is then applied so with probability 
Pnoise the new speed is v t +\ = v sa fc — 1, otherwise Vt+i = w sa fc- Finally, in the bulk 
of the lane, the vehicle hops Vt+i cells ahead, so that x t+ i — x t + Vt+i- For each 
lane, all vehicles in the bulk of the lane are updated in this way in parallel. It is 
known from freeway studies that the random deceleration step is crucial for obtaining 
a realistic model [T]. In our simulations we set p no ise = 0.2 if v < v max and p n oisc = 0.5 
if v = v ma x, and so we have what is known as a velocity dependent randomization 
(VDR) model in the statistical mechanics literature (see e.g. [23]). If a vehicle v lies 
in cell x t > L — v max — 1 and has no occupied cells in front of it then we set h t = » max ; 
if v has sufficiently low speed it will then be updated via NaSch in the same way as 
any other vehicle on the lane, otherwise such vehicles are handled separately by the 
mark paths and clear paths routines, see Appendix A. 4 and Appendix A. 5 



Algorithm [7J which uses the NaSch speed function, is applied to each lane of 
each bulk link, at each time step. The association of vehicles with paths, v O P, and 
the marking of vehicles as needing to stop, referred to in algorithm [7J is performed by 
the mark paths routine; see algorithm [8] in section [Appendix A.4| We emphasize here 
however that it is only the very last vehicle on a lane that may be associated with 
paths or required to stop. 



Appendix A. 4- Mark Paths. 

By marking paths for a given link I = mn we mean that we consider each lane A of I, 
and determine whether or not A has a vehicle v which is sufficiently close to the end 
of A, and traveling sufficiently fast, that a naive application of NaSch dynamics could 
move v past the end of ^ If this is the case we search for a path P of the active 
phase 'Pactive which has in(P) = A and out(P) <G turn(v), where turn(v) denotes the 

tt We emphasize that due to the nature of NaSch dynamics, there can be at most one such vehicle 
at each time step. 
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Algorithm 7 (NaSch network) 

Consider lane A of length L 
for every cell i = 0, . . . , L — 1 do 
if cell (i) contains a vehicle v then 
if v O P /or some pai/i P f/ien 

return 
end i/ 

if v has been marked as needing to stop at the end of A then 

Stop v at the end of A 

return 
end if 

Set speed(v) = NaSch(v) 
Move v from i to i + NaSch(v) 
end if 
end for 



unique outlink of n onto which v originally decided to turn when it first entered link 
I. If there exists such a path P then v could make its desired turn during the current 
iteration by traversing P, and so in such a case we associate P and v, a relationship 
that we abbreviate with P ■<-» v. When a path has been associated with a vehicle in 
this way we say it has been marked. The actual traversal of v along P will take place 
when we clear paths, provided there are no other marked paths to which P must give 
way; this is discussed further in section [Appendix A.5| 

In practice, we perform path marking by applying algorithm [8] to each lane of 
each link of the network. Recall that P„ is the set of all paths of node n and that 

P v = {P G V n : in(P) G link(v) & out(P) G turn(v)}. 

Some comments are in order. Firstly, note that we compute the NaSch speed 
using p n oisc = 0, regardless of the value we use in the NaSch updates, to ensure that 
we identify all vehicles that could possibly move past the end of their lane in one NaSch 
update. Secondly, note that the set A\ is the set of all paths P which are available for v 
to traverse during the current iteration, without regard to whether they are consistent 
with v's turn decision; i.e. regardless of whether or not they satisfy out(P) G turn(v). 
Therefore, A\ fl P v is simply the set of all P G A\ for which out(P) G turn(v). If 
there are any paths at all in P„ along which a vehicle on lane A can move to the link 
turn(v), then we demand that v may only be associated with such a path, even if no 
such paths belong to the current A\ . If such paths do indeed exist but do not belong 
to the current A\ then v is flagged as needing to stop at the end of A. The vehicle will 
then wait at the lights until an appropriate phase, consistent with its turn decision, 
becomes active. However, it is possible that despite all the topological lane changing, 
a vehicle v may end up in a lane which is inconsistent with its desired turn decisiorfff) 
When such a case arises, rather than let v block traffic we demand that it give up on 
its turn decision and simply randomly chose one of the paths currently available to it 
if one exists, otherwise we again stop v at the end of A. Recall that if v is flagged 

ft Empirically, for the Kew network this seems to happen to about 3% of vehicles, which therefore 
does not significantly affect the effective origin-destination data encoded in the turning probabilities. 
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Algorithm 8 (Mark paths) 

Suppose the last occupied cell of lane A of link I — mn contains vehicle v 
Let A\ = {P € Tractive : in(P) = A & out(P) has space} 
if cell (v) + NaSch Paaiso= o(v) > length(X) then 
if {PeV v : in(P) = A} ^ then 
if A x nV v 7^ then 

UAR, choose P G Ax H V v and associate Pf>v 
else 

Mark v as needing to stop at the end of A 
end if 
else 
if A x 7^ *^en 

UAR, choose P G .Aa associate P v 
e£se 

Mark v as needing to stop at the end of A 
end i/ 
end i/ 
end i/ 



as having to stop at the end of A then this move is actually performed by NaSch; 
see |Appendix A.3| Finally, in algorithm [8] we use the prescription in algorithm [9] to 
determine if a lane has space. 

Algorithm 9 (Has space) 

Consider path P 

if out(P) belongs to a bulk link then 
if the first cell of out (P) is empty then 

out(P) has space 
end if 

else if out (P) belongs to a boundary link then 

out(P) has space with probability (1 — px,i) 
end if 



Finally, note that we perform path marking before the NaSch updates because in 
order for algorithm [l] to be parallel we need the determinations of whether a given 
lane has an empty first cell to occur before we update these cells. We also require the 
marking information within NaSch so that we can correctly stop vehicles on the end 
of their lane if need be. 

Appendix A. 5. Clear paths. 

Recall that for a given node, and a given phase, each path has associated with it a list 
(possibly empty) of other paths in the same phase to which it must give way. If path 
P' is listed in path P's give- way list, and both P and P' are marked, then P will not be 
cleared during the current iteration. In this sense P' has priority over P. In practice, 
P' might represent a vehicle traveling straight through a four-way intersection while 
P represents a vehicle traveling in the opposite direction and wishing to turn right 
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(cf. paths Pq and P3 in figure Al). Algorithm 10 describes the clear path routine in 
detail. 

Algorithm 10 (Clear paths) 

Consider node n 

for each marked path P € V n do 

if there is another marked path to which P must give way then 

Move the vehicle v -H- P to the last cell of in(P) 

Give v speed 

Disassociate P and v 
else 

if out (P) belongs to a bulk link then 

Move the vehicle vf)P (o the first cell of out (P) 
if speed(v) — then 

Set speed(w) = 1 
end if 

else if out (P) belongs to a boundary link then 

Delete v o P 
end if 
end if 
end for 



Appendix A. 6. Choose phases 

This depends on the choice of signal rules, of which there are infinitely many one may 
consider. Perhaps the simplest rules are simply fixed cycle rules; for each node we have 
an ordered list of phases (Pi, . . . , V m ) and an ordered list of split times (ti, . . . ,t m ). 
We then cycle through these phases according to the corresponding split times; phase 
Vi is the active phase for ti iterations, then Vi+x is the active phase for £j_|_i iterations, 
etc. 

More sophisticated rules may choose the active phase based on the actual network 
configuration. One examples is the self-organized traffic lights discussed in section [3] 
The implementation of this rule is given in Algorithm [2] 
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